Multilevel parametric-base F0 model for speech synthesis
نویسندگان
چکیده
This paper proposes a new F0 model for speech synthesis based on the parameterization of the logF0 contour of the syllables. This parameterization consists of the N -order discrete cosine transform (DCT) plus some additional parameters such as the gradient of the syllable average pitch. A statistical model of the syllable pitch contour is then created by clustering the parameterized vectors with a decision tree. Similar statistical models are also created for other linguistic levels other than the syllable. For synthesis, the statistical model of each level is used to define a log-likelihood function for the input text. These functions are then weighted and added into a global log-likelihood function which is then maximized with respect to the DCT coefficients of the syllable model. The final logF0 contour is obtained from the inverse transformation of the syllable DCT coefficients. A subjective test showed a clear preference for the proposed model against our previous HMM-based baseline.
منابع مشابه
A Statistical Phrase/Accent Model for Intonation Modeling
This paper proposes a statistical phrase/accent model of voice fundamental frequency(F0) for speech synthesis. It presents an approach for automatic extraction and modeling of phrase and accent phenomena from F0 contours by taking into account their overall trends in the training data. An iterative optimization algorithm is described to extract these components, minimizing the reconstruction er...
متن کاملAsynchronous F0 and spectrum modeling for HMM-based speech synthesis
This paper proposes an asynchronous model structure for fundamental frequency(F0) and spectrum modeling in HMMbased parametric speech synthesis to improve the performance of F0 prediction. F0 and spectrum features are considered to be synchronous in the conventional system. Considering that the production of these two features is decided by the movement of different speech organs, an explicitly...
متن کاملFeedback loop for prosody prediction in concatenative speech synthesis
We propose a method for concatenative speech synthesis that permits to obtain a better matching between the logF0 and duration predicted by the prosody module and the waveform generation back-end. The proposed method is based upon our previous multilevel parametric F0 model and Toshiba’s plural unit selection and fusion synthesizer. The method adds a feedback loop from the back-end into the pro...
متن کاملQuantitative analysis of F0 contours of emotional speech of Mandarin
For emotional speech synthesis, a quantitative model giving a parametric representation of F0 contours is needed. Purpose: investigate quantitatively F0 characteristics of Mandarin speech in four basic emotions (anger, fear, joy, and sadness) and in neutral reading. Two approaches are compared: surface features analysis from time-normalized F0 contours analysis-by-synthesis of time-intact F0 co...
متن کاملModel-Based Parametric Prosody Synthesis with Deep Neural Network
Conventional statistical parametric speech synthesis (SPSS) captures only frame-wise acoustic observations and computes probability densities at HMM state level to obtain statistical acoustic models combined with decision trees, which is therefore a purely statistical data-driven approach without explicit integration of any articulatory mechanisms found in speech production research. The presen...
متن کامل